How powerful are integer-valued martingales? 
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Abstract. In the theory of algorithmic randomness, one of the central 
notions is that of computable randomness. An infinite binary sequence X 
is computably random if no recursive martingale (strategy) can win an 
infinite amount of money by betting on the values of the bits of X. In 
the classical model, the martingales considered are real-valued, that is, 
the bets made by the martingale can be arbitrary real numbers. In this 
paper, we investigate a more restricted model, where only integer-valued 
martingales are considered, and we study the class of random sequences 
induced by this model. 



1 Gambling with or without coins 

One of the main approaches to define the notion of random sequence is the so- 
called "unpredictability paradigm" . We say that an infinite binary sequence is 
"random" if there is no effective way to win arbitrarily large amounts of money 
by betting on the values of its bits. The main notion arising from this paradigm is 
computable randomness, but other central notions such as Martin-L6f random- 
ness, Schnorr randomness, and Kurtz randomness, can be formulated in this 
setting. For all of these notions, we consider models of games where the player 
can, at each turn, bet any amount of money between and his current capital. 
In "practice" however, one cannot go into a casino and bet arbitrarily small sums 
of money: there is always a unit value, and any bet made has to be a multiple of 
this value. Some casinos (and games) also impose upper limits on the amount of 
capital the one can gamble in each round of play. In the following exposition, we 
examine the consequences of restricting betting amounts to integers and finite 
sets. 



To formalize the unpredictability paradigm, we need the central notion of 
martingale. A martingale is a betting strategy for a fair game and is formally 
represented by a function that corresponds to the gambler's fortune at each 
moment in time. Let {0, 1}* denote the set of all finite binary sequences, and 
{0, l}"^ is the set of all countably infinite binary sequences (a.k.a reals). Any 



function M : {0, 1}* — ^ which satisfies the fairness condition 

Mia) = + (1.1) 

for all cr e {0, 1}* is called a martingale. M{a) corresponds to the gambler's cap- 
ital after having already bet on the finite sequence a. The fairness condition (ll.ip 
says that the amount of money gained from an outcome of "0" is the same that 
would be lost from an outcome of "1" . It is important to note that our definition 
of martingale is a very restricted version of what is usually referred to as "mar- 
tingale" in probability theory, where it is defined to be a sequence Xq , Xi , . . . 
of real- valued random variables (possibly taking negative values) such that for 
all n 

^[Xn+l\XQ, Xi, . . . , Xn] — Xn- 

To make the distinction, we call such a sequence a martingale process. A martin- 
gale is called recursive if M is a recursive function. Throughout this exposition, 
"martingale" and "recursive martingale" will be used synonymously. 

For any A G {0, l}"^, A ff n is the finite binary sequence, or initial segment^ 
consisting of the first n digits of A. A denotes the complement of a set A (when 
seen as a subset of N). We also identify sets with their characteristic sequences. 
\a\ denotes the length of a binary sequence a. A martingale M succeeds on A £ 
{0, l}"^ if M achieves arbitrary sums of money over A, that is, limsup„ M{A ff 
n) = oo. Otherwise A defeats M . M Schnorr- succeeds on a set A if M succeeds 
on A and there exists a recursive, non-decreasing, unbounded function / such 
that f{n) < M(A [f n) for infinitely many n. M Kurtz- succeeds on a set A 
if M succeeds on A and there exists a recursive, non-decreasing, unbounded 
function / such that /(n) < M{A ff n) for all n. We can now define the main 
classical notions of randomness in terms of martingales. 

Definition 1. A sequence A e {0, l}"^ is called computably random if A defeats 
every martingale. If no martingale Schnorr-succeeds on A, then A is Schnorr 
random. If no martingale Kurtz-succeeds on A, then A is Kurtz random (equiv- 
alently, A is Kurtz random if and only if A does not belong to any 77° subset of 
{0, 1}" of measure 0). 

In this paper, we shall consider games where the player can only make bets 
of integer value. For M a martingale and a € {0, 1}*, \M{aO) — M{a)\ is called 
the wager at a. Now, given a set V of non-negative integers, we say that a 
martingale is V -valued if for all a the wager of M at cr belongs to V , unless M 
does not have enough capital in which case the wager at cr is 0. Formally, M is 
y- valued if for all a G {0, 1}* and a G {0, 1}, M(cr) < min(y) ^ M{aa) = M{a) 
and M(cr) > min(y) \M(aa) — M{a)\ & V. A martingale whose wagers are 
integers is called an integer-valued martingale. In case V is finite we say that M 
is finitely-valued and if ^ is a singleton, that M is single-valued. 

Definition 2. A real X is V -valued random if no valued martingale succeeds 
on X. A real X is a finitely-valued / integer-valued / single-valued random if no 
finitely- valued / integer- valued / single- valued martingale succeeds on X. 



The rest of the paper studies how these new notions of randomness interact 
with the classical ones. We will prove the implications of the following diagram: 



computably random 

; 




Schnorr random — > law of large numbers 




and we shall further see that no other implication than those indicated (and their 
transitive closure) holds. We than an infinite set is called immune if it contains 
no infinite r.e. set. Even stronger, an infinite set A = {ao < ai < a2 < • ■ ■ } is 
hyperimmune if there exists no recursive function / such that /(n) > a„ for all 
n |13| . A (hyper)immune set whose complement is also (hyper)immune is called 
bi- (hyper) immune. Thus a member of {0, 1}'^ is bi-immune if and only if there 
no recursive list of positions containing all O's or all I's. A set A is Uq if A can 
be defined using a formula with n quantifiers followed by a recursive predicate 
where the leading quantifier is existential. 0' denotes the halting set, and we say 
A is B -recursive if A is Turing reducible to B. 

For additional background on algorithmic randomness, see the forthcoming 
book of Downey and Hirschfeldt 4^ and the new book of Nies [9] . 

If we were to ask someone what the absolute minimum one could expect from 
a set called "random," you might receive one of the following two responses: 

1. The set obeys the law of large numbers. 

2. The set is bi-immune. 

The person who says "1" believes that a set which does not follow the law of 
large numbers exhibits a probabilistic bias in its distribution of O's and I's. The 
person who says "2" believes that a set with an infinite recursive subset of O's 
or I's yields algorithmic bias. There exists, however, a third possibility: 

3. The set is single- valued random. 

"3" closely matches our intuition in the sense that one should not be able to pre- 
dict successive outcomes resulting from a "random" process. From a practical 
point-of-view, single- valued randomness also makes sense. If you have to sit out 
21000 j-Qunds of roulette before placing a sure bet, as might occur when gambling 
on a non-bi-immune set, then with probability 1 the casino has already closed 
while you were waiting for this opportunity. In Section [3l we shall prove that 
notion "3" indeed differs from notions "1" and "2." 

The separation of Kurtz randomness and Schnorr randomness is folklore 
(we will see in a moment how it can be proven). A somewhat more difficult 



result is the separation of computable randomness and Schnorr randomness. 
The separation of these two notions was proven by Wang who constructed a 
Schnorr random sequence X together with a martingale M that succeeds on X. 
It turns out that in Wang's construction, the martingale M is already {0, 1}- 
valued, hence it immediately follows that Schnorr randomness (a fortiori Kurtz 
randomness) does not imply finitely-valued randomness (and a fortiori integer- 
valued randomness). 

Theorem 3 (Wang [15j). There exists a Schnorr random X E {0, 1}" and a 
{0, 1} -valued martingale M such that M succeeds on X . 

In Section [5] we shall see that conversely, integer- valued randomness does not 
imply Schnorr randomness, and a fortiori computable randomness. 

2 Integer-valued martingales and genericity 

There is an essential difference between rational- valued and integer-valued mar- 
tingales. The latter can always be permanently defeated while in general the 
former cannot be. Consider the example of a player starting with an initial cap- 
ital of 1 who at each turn bets half of its capital on the value 1 (that is, the 
corresponding martingale M satisfies M(crO) = M{a)/2 and M{al) = 3M((t)/2 
for all a € {0, 1}*). This is a rational- valued martingale with the following prop- 
erty. Pick a stage s of the game; no matter how unlucky the player has been 
before that stage, she always has a chance to recover. More precisely, for any 
finite sequence of outcomes cr € {0, 1}*, no matter how small M(cr) is, the player 
can still win the game if the remaining of the outcomes contains a lot of O's (for 
example the player wins against the sequence crOOOO . . .). This phenomenon no 
longer holds for integer-valued martingales, and in fact the opposite is true, that 
is, no matter how lucky the player has been up to stage s, there is always a risk 
for her to see her strategy permanently defeated at some stage s' > s. This is 
expressed by the following lemma. 

Lemma 4. Let M be an integer-valued martingale. For any a € {0,1}*, there 
exists an extension T{a,M) € {0,1}* of a such that M{t') = M{T{a, M)) for 
all extensions t' of T{a, M) (in particular the strategy M does not succeed on 
any X G {0, 1}"^ extending T{a, M) ). 

Proof. Let Af , a be fixed. We construct the string r = t(ct, M) via the algorithm: 

1. Set T ^ cr 

2. While there exists an extension r' of r such that M{t') < M{t) 

Choose any such r' and set t ^ t' (and go back to step 2.) 

3. Return(T) 

Note that this is algorithm in a general sense, that is, we do not claim that 
it can be implemented in a computable way (and indeed it cannot be, because 



the condition of the "While" loop needs to check the values Af (r') for all ex- 
tensions of r and there are infinitely many of them), but only that it outputs a 
correct value of r. First, to see that the algorithm terminates, notice that after 
each execution of the While loop, the value of M{t) is decreased, and because M 
has integer values, this means that M(t) is decreased by at least 1. Therefore 
the While loop is executed at most k = M(o') times. We also claim that the 
output r is correct: indeed it must fail the condition of the While loop, that is, 
for all extensions r' of r one has AI{t') > M{t). But the fairness condition of 
martingales implies that in that case, M{t') = M(t) for all extensions r' of r 
(this can be checked by a straightforward induction). □ 

From a topological perspective, the above result shows that any integer-valued 
martingale M is defeated on a dense open set. Indeed, for any cr, M is defeated 
by every sequence X e [T(cr, M)] hence M is defeated by any sequence in the 
dense open set 

i^M= U [t{<J,M)] 
cre{0.1}* 

(it is dense as for any a, [t{(t,M)] C [a] by construction). Therefore, the set of 
integer- valued random sequences contains the intersection over all integer- valued 
martingales (^Um- This is a countable intersection of dense open sets, hence the 
following corollary. 

Corollary 5. The set of integer-valued random sequences is co-meager. 

This shows that as a notion of randomness, integer-valued randomness is quite 
weak. Indeed, one of the most basic properties that we can expect from a random 
sequence X is that it satisfies the law of large numbers, that is, the number of 
O's in X [f n is n/2 -I- o(n). It is a routine exercise to show that the set of 
sequences X satisfying the law of large numbers is a meager set (contained in 
a countable union of closed set with empty interior). Therefore, in the sense 
of Baire category, most sequences are integer-valued random but do not satisfy 
the law of large numbers. On the other hand, it is well-known that any Schnorr 
random sequence must satisfy the law of large numbers 9 , which yields a further 
corollary. 

Corollary 6. There exists a sequence X G {0, 1}" which is integer-valued ran- 
dom but not Schnorr random. 

If we now want to compare integer-valued randomness and Kurtz random- 
ness, the above results are insufficient, as the set of Kurtz random sequences 
is also a co-meager set. We will prove that Kurtz randomness does not imply 
integer-valued randomness by looking at the classical counterpart of Baire cat- 
egory, namely genericity. Recall that a set W C {0,1}* is dense if the open set 
Uo-gM/I'''] dense or equivalently if for any string a there exists a string in W 
extending a. We say that X G {0, l}"^ is weakly n-generic if X has a prefix in 
every dense 17° set. We further say that X is n-generic if for any (not necessarily 



dense) 17° set of strings W, either X has a prefix in W or there exists a prefix 
of X which has no extension in W. For all n > it holds that 

weakly (n+l)-generic n-generic ^ weakly n-generic. 

Kurtz showed that weakly 1-genericity is enough to ensure Kurtz randomness. 

Proposition 7 (Kurtz ^). Any weakly 1-generic sequence X e {0, 1}"^ is 
Kurtz random. 

The next two theorems show that more genericity is needed to ensure integer- 
valued randomness. That is, weak 2-genericity is sufficient, but 1-genericity is 
not. 

Theorem 8. Let X G {0, 1}" be any weakly 2-generic sequence. Then X is 
integer-valued random. 

Proof. We have shown in Lemma S] that for any martingale M € S) , the set of 
strings 

Wm = {c : M{<t') — M{a) for all extensions a' of ct} 

is dense. It is also easy to see that this set is recursive in 0', in particular Wm 
is - By definition, a weak-2-generic sequence X must have a prefix in Wm for 
all integer- valued martingales M, and it is clear that if X has a prefix in WM^ 
M does not succeed on X. □ 

Theorem 9. There exists a 1-generic sequence X G {0, 1}'^ and a {0, \}-valued 
martingale M such that M succeeds on X . 

Proof. We will build the sequence X by constructing an increasing (for the 
prefix order) sequence (7„) of strings, then taking X to be the unique element 
of {0, 1}'^ having all of the 7„ as prefixes. The martingale we construct will be 
{0, 2}-valued, however a successful {0, l}-valued martingale can also be achieved 
by cutting the {0, 2}-valued wagers in half. 

Let (VFe)eeN be an effective enumeration of all Z"" sets of strings. For all e, 

set 

Fg = {t : 3ct e W^e,|r| and r extends a} 

and F™™ the set of minimal elements of Fe, that is, the set of r such that r € Fe 
and no strict prefix of r is in F,. . Note that whenever a string a is in Ff. , then so 
are all strings that extend cr, and whenever a string a is F™™, then no strict ex- 
tension of (7 is. It is clear that the F^ and F™'" are (uniformly) recursive sets, and 
also easy to see that a sequence Y £ {0, 1}" is 1-generic if and only if for all e, ei- 
ther Y has a prefix in Fg (resp. F™'") or some prefix of Y has no extension in Fg. 

We start by defining the martingale M which will succeed on the sequence X. 
It is defined by M{e) = 12 and for aU a e {0, 1}* and a e {0, 1}: 

{M(ct) + 2 if M{a) > permit((T) and a = 1 
M{a) - 2 if M(cr) > permit(cr) and a = 
M (a) if M(a) < permit((T) 



where the function permit is defined inductively by 



permit(e) = 4; 

permit(cra) = min [{permit(CT) + 1} U {4e + 4 : era e i^"'"}] • 

for a e {0, 1}* and a € {0, 1}. It is also easy to see that permit and M are 
recursive, and M is integer- valued (its values are positive because permit (a) > 4 
for all cr, hence M is never allowed to make a bet if its capital is less than 4). 

We now define the sequence of strings (7n), and an axixiliary sequence (Cn) 
by setting 70 = e, Co = e and inductively, for all n: 

(a) if there exists an extension of 7„ in Fn then let Cn+i be a shortest such 
extension (chosen eflfectively) , and 

(b) if there exists no such extension, let Qn+i = In- 

Finally, define 7n+i = Cn+illlimi- 

Note that Cn can be determined from 7„ using the oracle 0', hence the se- 
quence X obtained in this construction (by taking the limit of the 7„, or equiv- 
alently the limit of the Cn) is also recursive in 0'. We now prove that X is as 
wanted by a series of claims. 

(i) X is 1-generic. Indeed, at stage n of the construction, either Qn is in F„ (in 
fact in -F™'") or no extension of Cn is in -F„. 

(ii) In both cases (a) and (b) of the construction, we ensure that no strict ex- 
tension of C„ is in F™™. Indeed either case (a) holds, and Cn is itself in F™™ 
in which case no strict extension of Cn is, or case (b) holds, in which case no 
extension of Cn is in F„, and fortiori no extension is in F™™. Additionally, 
for all n, C,i is a strict extension of all Cfe for k < n, therefore we conclude by 
induction that for all n and all k < n, no strict extension of is in F^™. 

(iii) For all n, permit(Cn) > 4n + 4, and moreover, any string a extending Cn by 
at least 4 bits satisfies permit(c7) > 4n+8. This is shown by induction. First, 
this holds for n = 0: all values of the function permit are greater or equal 
to 4, in particular, permit(Co) > 4. Now suppose that permit(Cri) > 4ri + 4 
for some n. As we have seen in claim (ii) above, no strict extension of (n is 
in Ffe for any k < n. Thus, for any extension (' of Cn and a e {0, 1} we have 
by definition of permit: permit(C'a) > min{permit(C') + l,4n + 8}. From 
this, we see by a straightforward induction that string a extending by 4 
bits or more satisfies permit(cr) > 4n + 8. In particular, Cn+i extends Cn by 
at least 8 bits, hence permit(Cn+i) > 4n-|-8, which concludes the induction. 

(iv) Similarly, for all n, permit(7„) > 4n -|- 4. This is true for n = 0, and for 

n > 0, since 7„ is an extension of Cn-i by 8 bits, it follows from (iii) that 
permit(7„) > 4(n - 1) + 8 = 4n + 4. 



(v) For all n, M{jn) > permit(7„) + 8. This is true for n — 0. For the in- 
duction step, we need to distinguish two cases depending on how 7„+i 
was constructed from 7„. If we are in the above case (b), then 7n+i = 
7„ 11111111, and since M(7„) > permit (7„), M bets and wins 8 consecutive 
times, and thus M(7„+i) = A/(7„) + 16. Also, in that case permit(7„+i) < 
permit (7„) + 8 by definition of permit (adding one bit to a string can only 
increase the value of permit by 1). From these two facts we can conclude 
that A/(7„+i) > permit(7„+i) + 8. Suppose now that 7„+i was constructed 
according to case (a) above. In that case, we need to precisely analyze the 
behavior of M and permit between <^„ and 7„, i.e. on strings of type C„?7 
with < |?7| < |7„| — ICnl- First, C„ is an extension of 7„-i hence by (ii) no 
string C„?7 is in F™'" for fc < n. Additionally, since 7,1 belongs to -F™'", no 
prefix of 7„ does. This shows by definition of permit that for I77I < 4 one has 
permit(C„77) = permit(C„)+|r;| and for \ri\ > 4 one has permit(^„77) > 4ri+8. 
On the other hand, M (7„) > permit(7„)-|-8 > 4n+12 (by (iv)). Since M can 
only decrease by 2 at each move, we have M(C„?7) > 4n + 6 for any \ri\ < 3. 
But if I77I > 4, as we just saw, the value of permit(C„r/) is at least 4n + 8, and 
the martingale M is never allowed to bet if its capital is below permit. Hence, 
it follows that M{Cnf]) > 4ri-|-6 whenever < |r/| < |7„| — |C„|. In particular, 
M{(n) > 4n + 6, and since we are in case (a), permit(C„) < 4n + 4, thus M 
is allowed to bet and wins 8 times consecutively, and M{jn+i) > An + 22. 
Finally, we have permit(7„+i) < permit(C„) + 8 < 4n + 12. This finishes 
the induction. 

We have seen in (i) that X is 1-generic, and from (iv) and (v), it follows that 
limsup„ Af (7„) = +00, hence M succeeds on X. □ 

The sequence X constructed in this last proof is 1-generic, hence by Kurtz's 
result mentioned above X is also Kurtz random. We therefore get the immediate 
corollary. 

Corollary 10. There exists a sequence X e {0, 1}" which is Kurtz random hut 
not integer-valued random. 

The converse of this result is also true, that is there exists a sequence X which 
is integer-valued random but not Kurtz random. To prove this, we will need a 
different approach, via measure-theoretic arguments, which we will present in 
Section El 

Strictly speaking, integer- valued martingales not only impose a lower limit on 
betting amounts but also require that all wagers be a multiple of the minimum 
bet. We are therefore left with a question regarding the robustness of integer- 
valued randomness: if we remove the requirement that wagers must be a multiple 
of the minimum bet, do we still obtain the same notion of randomness? 

Open question 11. Let V be the set of all computable reals greater than or 
equal to 1 unioned with {0}. Is V -valued random the same as integer-valued 
random? 



3 Finitely-valued martingales 

We now consider the effects of imposing betting limits on martingale strategies. 
First we separate integer- valued randomness from finitely- valued randomness. 

Theorem 12. There exists an integer-valued martingale which succeeds on a 
finitely-valued random. 

Proof. Partition the natural numbers into finite intervals, with 2" intervals of 
length n followed by 2"+^ intervals of length n + 1 for every n. In a picture: 



where each interval has length n. Consider the class of all sets A which 
guarantees that at least one "1" lies in each of these intervals. An integer-valued 
martingale can succeeds on any set in this class by using the "classic" martingale 
strategy: in each interval bet $1 on outcome "1" , then bet $2 on outcome "1" , 
then bet $4 on outcome "1" , etc. until the bet is successful and then stop betting 
until the next interval. In this way, the gambler nets $1 income over each interval. 
After doing this for each of the 2" intervals of length n, she has enough money 
to continue this strategy on the next intervals of length n + 1. Therefore some 
integer- valued martingale succeeds on every member of A. 

On the other hand, we now find a, B € A on which no finitely-valued mar- 
tingale succeeds. Lcit Mq, Mi, M2, ... be a list of all finitely-valued martingales. 
Let B{0) = 1. For induction assume B has been defined up through /„, and try 
to define B on /„+i so that 

— for some e. Me loses some money over In+i, and 

— for every j < e, Mj gains no money over 

If all the intervals B are chosen so as to satisfy these requirements, then all 

finitely-vahied martingales will be obliterated. Indeed each index can only be 
chosen finitely many times to play the role of e before all the capital of Me is 
destroyed, and therefore the choice of e must go to infinity. 

While; it is impossible to choose values for B so that these requirements 
are satisfied on every interval, we can satisfy them often enough to defeat ev- 
ery finitely- valued martingale. Assuming that 7„_i has been built, we describe 
how to build /„. Recall that a finitely- valued martingale always wagers integer 
dollar amounts. For each finitely-valued martingale M, let max(M) denote the 
maximum possible bet for M, and let 



Claim: Values for B can be chosen in 7„ so that M^ loses money if she makes 
a nonzero wager before the last L{e) positions of the interval and is the 
lowest-indexed martingale to do so. Furthermore for all j < e, Mj does not 
gain any money over 7„ with these values for B. 
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Thus if Mo bets before the last L{0) positions oi In, B can force Mq to fose money, 
thereby satisfying the construction requirements. So we need only consider the 
case where Mq bets no money before the last 1/(0) positions of /„. By applying 
the claim above inductively, we may assume that 

— each successive Mg bets no money prior to the last L{e) positions of 7„, and 

— for each j < e, Mj earns no profit over J„. 

Eventually B must encounter some martingale Ms which is stupid enough to 
bet money at the beginning of the interval, at which point the requirements for 
In can be satisfied (assuming 7„ is sufficiently long to have such a "beginning.") 
If /„ is not longer than L{s) then the requirements arc not satisfied on /„. But 
we do not worry about this failure because for all e such that L{e) < the 
way of choosing intervals prevents Me from ever earning money again on any 
interval In+k {k > 0). Thus for every e, there is a sufficiently large so that for 
all n > A^, e gains no money from betting on J„. So i? defeats all finitely- valued 
martingales. 

It remains to prove the claim. We argue by induction. Suppose that Mq 
makes a nonzero wager prior to the last L(0) positions of the interval /„, say at 
position xq. We show how B can force M(0) to lose money over 7„. B can act 
adversarially throiighout the interval except for the constraint inherited from 
the class A. It follows that Mq's betting amounts must be nondecreasing from 
position xo until the end of the interval. If not, then B can spend its obligatory 
"1" at the; position where Mq decreased her bets. Mq already has a net loss at 
this point of decrease, and B can continue to act adversarially until the end. 
Therefore a decrease in betting amounts after xq would cause Mq to lose. Hence 
Mq is forced to bet at least $1 each of L{0) times. By the final bet in J„, Mq is 
already behind by at least max(Mo) + 1, so this bet is irrelevant; Mq has already 
lost. 

Since we have already proved the claim when Mq bets before the last i(0) 
positions, we can now focus on the case where Mq bets only during the last 1/(0) 
positions. Now it is easy to prevent Mq from winning any money: B places a "1" 
anywhere before the — L{0) position and then B can act adversarially on the 
last L{0) positions. Any nonzero wager from Mq will now instantly result in a 
loss for Mo because B is free to everywhere disagree with Mo. Hence it suffices 
to consider the case where Mq does not bet anywhere and B is obligated to post 
a "1" somewhere before the last — L{0) positions. 

Curiously, Mi now finds herself in exactly the same situation that Mq started 
with. By same argument as above, B can force Mi to lose money if Mi bets prior 
to |/„| — L(l). Therefore we can reduce to the case where Mi never bets and B is 
obligated to provide a "1" somewhere before L{2). The same argument holds for 
M2 , M3 , . . . . Eventually some martingale M,, has money and is stupid enough 
to bet before L{e). At this point, the claim is proved. □ 

Remark. B is O'-recursive in the above construction. 



Schnorr showed that for any set A, a real-valued martingale succeeds on A if 
and only if a rational- valued martingale succeeds on A (see [TT], or [S] p. 270). 
His proof, however, does not carry over to the finitely-valued case. 

Open question 13. // we allow finitely-valued martingales to bet real values 
instead of rationals, do we get the same class of finitely-valued randoms ? 

3.1 On single-valued randoms 

For the following discussion, it is useful to keep in mind that a real is single- valued 
random if and only if it is {l}-valued random; the particular dollar amount 
which is bet each round is immaterial. For comparison with Kurtz randomness, 
we appeal directly to a theorem of Doob ([3 p. 324). The following version for 
"non-negative" martingales appears in Ross's book ( 10 , p. 316). 

Theorem 14. For every martingale M , the set of reals on which M succeeds 
has measure zero. Furthermore, the capital of M converges to some finite value 
with probability 1. 

Later, in Lemma [311 we shall appeal to a more general version of Theorem [T3] 
(see Billingsley [5] p. 468). A supermartingale process a sequence Xq,Xi, ... of 
real- valued random variables (possibly taking negative values) such that for all n 

^[Xn+l\Xo, Xi, . . . ,Xn] < Xn- 



Theorem 15 (Doob's Martingale Convergence Theorem). Let Xq, Xi, . . . 

be a supermartingale process (where each Xi is a random variable). If for some 
m e R, we have Xn > m for all n, then almost surely lim„_j.oo Xn exists and is 
finite. 

Proposition 16. Every Kurtz random is single-valued random. 

Proof. Suppose that some single- valued martingale M succeeds on a real X. Let 
denote the set of reals on which AI converges to some finite value. Then X 
does not belong to J^, and has measure one by Theorem [TH Hence X belongs 
to the measure zero set J-. 

By definition of single- valued, M is required to bet at every position of the 
input real. Hence the only way for M to converge to a finite value is to reach 
the value and become constant. Therefore J- is, in fact, the set of reals on 
which M eventually goes broke. Thus is the set of all infinite paths through 
the tree {a : M{a) > 0}. It follows that is a recursive 77° class. In summary, 
X belongs to a recursive 77° class of measure zero and therefore is not Kurtz 
random. □ 

Remark. The above argument shows even more: every Kurtz random is t^- valued 
random for any positive set of integers V. 



As promised in the introduction, we now separate the incomparable notions of 
bi-immunity, single-valued random, and law of large numbers. The reals sat- 
isfying the law of large numbers and the bi-immune reals are already known 
to be different. Their separation can be deduced from the argument given in 
Proposition [20l with "bi-immune" substituted for "single- valued random." 

Theorem 17. There exists a single-valued random which is neither immune nor 
co-immune. 

Proof. Let Mo,Mi,... be a list of all possible {l}-computable "gamblers," 
namely a list of pairs consisting of martingales and their respective initial capital. 
Define a set A such that 

— A{n) = 1 if n = mod 6, and 

— A{n) = if n = 3 mod 6. 

The remaining values of A work adversarially against the M^'s. Since the gam- 
blers must bet exactly $1 on each value of A, the remaining values of A can be 
chosen so as to force any particular gambler to decrease his capital by a dollar 
over the course of any three consecutive rounds of play. We define the first initial 
segment of A so as to exhaust the capital of Mq, the following interval of A so 
as to exhaust the capital of Mi, etc. Since each gambler has only finite capital 
at any moment, each gambler's capital is exhausted after a finite period of time. 
Therefore no {l}-valued martingale succeeds on A. Furthermore, by the values 
assigned at multiples of 3, A contains an infinite recursive set as does its com- 
plement. □ 

Theorem 18. There exists a 0' -recursive, bi-hyperimmune set which is not 
single-valued random. 

Proof. Let ipo,(pi,(p2, ■ . ■ be a list of the partial recursive functions. Define a 
O'-recursive function / satisfying 

(Ve < n) [Mfin)) i =^ f{n + 1) > Mfin)) + 2] 

and let 

A = {x: {3n) [f{2n) <x< f{2n + 1)]}. 
Now A — {oq, oi, 02, . . . } is bi-hyperimmune because for any recursive (pk, 

Vk[f{2k + 1)] < f{2k + 2) - 2 < a/(2fc+i) - 1, 

and a similar inequality holds for the complement of A. On the other hand, 
the single- valued martingale strategy which bets on A{n -\- 1) what the gambler 
saw at A{n) will succeed on A. This strategy indeed succeeds because each time 
A{n -\- 1) disagrees with A{n), we have that A{n -\- 2) and A{n -f 3) agree with 
A{n-{-l). So over each three consecutive rounds of betting, the gambler increases 
his capital by at least $1. □ 



Proposition [T6l and Theorem [TSl together give: 



Corollary 19. There exists a bi-immune set which is not Kurtz random. 

Proposition 20. Single-valued random does not imply the law of large numbers 
and vice-versa. 

Proof. Unlike the set of reals which satisfy the law of large numbers, the set of 
single- valued randoms is co-meager (by Corollary [5|) . Moreover, the real .010101010 
satisfies the law of large numbers but is not single- valued random. □ 

Finally, we note that it is possible to separate single-valued randomness from 
finite- valued randomness using an argument along the lines of Proposition 1171 

Proposition 21. There exists a {l,2}-valued martingale which succeeds on a 
single-valued random. 

Proof. Similar to Theorem 1171 we partition the natural numbers into intervals 
of length 5. For the first two numbers n in each interval (that is, n congruent to 
or 1 (mod 5)), set A{n) = so that gambler can win at these places. The last 
three spots in each interval are adversarial against the single- valued martingales. 
A will be able to defeat the {l}-valued martingale since the best single- valued 
martingale strategy would first gain $2 and then lose $3 on each interval, for 
a net loss of $1 per interval. Eventually the single- valued martingale will run 
out of money. On the other hand, there exists a {1, 2}-valued martingale which 
always bets $2 on each of the first two numbers and $1 on the last three numbers 
in each interval, for a net gain of at least $4 - $3 = $1 per interval (regardless 
of any adversarial action that may occur in the last 3 places). Thus the money 
for this {1, 2}-valued martingale on A goes to infinity. □ 

3.2 On {0,l}-valued randoms 

We can also separate single- valued randomness from finite- valued randomness. 

Proposition 22. Let V be any set containing and at least one other number n. 
Then any V-valued random is bi-immune. 

Proof. Let j4 be a set which is not bi-immune; without loss of generality assume 
that A contains an infinite recursive set B. Then a y- valued martingale strategy 
which bets n dollars on members of B and on A — B will succeed on ^. □ 

The following corollary is a consequence of the definition of finitely- valued ran- 
dom and Proposition [22l 

Corollary 23. finitely-valued random => {0, 1} -valued random => bi- 



Since single- valued random does not imply bi-immune (Theorem 1 17p . we obtain 
from Corollary [23l 



immune. 



Corollary 24. There exists a {0, l}-valued random which is not single-valued 
random. 



Although we were able to separate single- valued randomness from {1, 2}-valued 
randomness (Proposition , the comparison between {0, l}-valued randoms 
and {0, 1, 2}-valued randoms seems less clear. We leave the reader with the fol- 
lowing interesting question. 

Open question 25. Is {0, l}-valued random the same as finitely-valued ran- 
dom? 

4 Integer- valued martingales and Bernoulli measures 

In this last section, we present a proof of the fact that integer- valued randomness 
does not imply Kurtz randomness. We will get a counter example by choosing 
a sequence X at random with respect to some carefully-chosen probability mea- 
sure. 

Intuitively speaking, the Lebesgue measure A on the space {0, 1}'^ corre- 
sponds to the random trial where all bits are obtained by independent tosses of 
a balanced 0/1-coin. An interesting generalization of Lebesgue measure is the 
class of Bernoulli measures, where for a given parameter 6 G [—1/2,1/2] we 
construct a sequence X by independent tosses of a coin with bias 6 (that is, the 
coin gives 1 with probability 1/2 -I- ^ and with probability 1/2 — ^. This can be 
further generalized by considering an infinite sequence of independent coin tosses 
where the n^^ coin tossed has bias (5„. This leads to the notion of generalized 
Bernoulli measures. Formally, on the space {0, l}"^, given a sequence ((5n)neN of 
numbers in [—1/2, 1/2], a generalized Bernoulli measure of parameter {Sn)neN is 
the unique measure fi such that for all a e {0, 1}*: 

n : (T{n)—0 n : cr(n) — 1 

where pn = 1/2 -I- 5„. One can expect that if the 5„ are very small (that is, Sn 
tends to quickly), then the generalized Bernoulli measure of parameter ((5„)„gN 
will not differ much from Lebesgue measure. This was made precise by Kakutani. 

Theorem 26 (Kakutani [5j). Let fi be the generalized Bernoulli measure of 
parameter {Sn)neN- If the condition 

Y,Sl<oo (4.1) 

neN 

holds, then fi is equivalent to Lebesgue measure X, that is, for any subset X of 
{0, 1}"^, Ai('^) — if and only if X{X) — 0. // condition j[ ) does not hold, then 
jj, and A are inconsistent, that is, there exists some y such that fi{y) ~ while 

x{y) = 1. 

If we want to work in a computability setting, we need to consider computable 
generalized Bernoulli measures, that is, those for which the parameter ((5„)„gN 
is a recursive sequence of reals. Vovk [13] showed a constructive analogue of 



Kakutani's theorem for computable generalized Bernoulli measures in relation 
with Martin-L6f randomness (perhaps the most famous effective notion of ran- 
domness, but we do not need it in this paper). The Kakutani-Vovk result has 
been used many times in the literature [11718112] . In particular, Bienvenu and 
Merkle proved the following. 

Theorem 27 (Bienvenu and Merkle [T]). Let fi be a computable generalized 
Bernoulli measure of parameter ((5„)„gN- ^/X^n ~ +00, then the class of Kurtz 
random sequences has ^-measure 0. 

To prove that integer-valued randomness does not imply Kurtz randomness, we 
will construct a computable generalized Bernoulli measure whose parameter 
(^n)neN converges to sufficiently slowly to have 5^ = -l-oo (hence by the 
above /^-almost all sequences X are not Kurtz random, which we will make even 
more precise) but sufficiently quickly to make ^ close to Lebesgue measure and 
ensure that /i-almost all sequences are integer-valued random. 

Theorem 28. There exists a sequence X G {0, 1}" which is integer-valued ran- 
dom but not Kurtz random. 

Proof. We obtain X by choosing a random sequence with respect to the gener- 
alized Bernoulli measure of parameter ((5„) with 



\/ n In n 

for all n > 1 (the values of (5o and 61 can be set arbitrarily). We have X]r=2 ^1 ~ 
Inlnn (this because / {thvt)^^dt — Inlni, in particular X- = -\-(X)). By Theo- 
rem [27l a sequence X chosen at random according to the measure pi will not be 
(with probability 1) Kurtz random. We can even exhibit a martingale M which 
wins against ^-almost all sequences X. It is defined by Af(e) = 1 and for any 
string (T of length n: 

M{aO) = (1 - 2Sn)M{a) and M{al) = (1 + 2(5„)Af(cr). 

This martingale is in fact the optimal martingale: when playing against a se- 
quence X that is chosen at random with respect to a measure i/, the optimal 
martingale is defined by M{a) = ;^([cr])/A([cr]). It is optimal in the sense that 
for any other martingale M', we have for /j,-almost all X € {0, 1}'^: M'{X ff 
n) — 0[M{X If n)] (see for example [T]). Here, if we take for i' our gen- 
eralized Bernoulli measure fi, the optimal martingale is exactly the martin- 
gale M. By Theorem [271 for /i-almost all X, X is not Kurtz random, that 
is, there exists a real-valued martingale M' and a recursive order h such that 
M'{X ft n) > h{n). But by optimality, for any real- valued martingale M' and 
/i-almost aU X, M'{X [f n) 0[M{X \] n)]. Putting all this together, there 
exists a recursive order h such that M{X ft n) > h{n) for all n and /i-almost 
all X. 

However (and this will be crucial for the rest of the argument), M succeeds 
quite slowly on average. 



Lemma 29. Let r > be a real number. Then for ^-almost all X e {0, 1}'^, 
one has M{X [f n) = o(n''). 

In order to prove this, we now see X as a random variable with distribution fj,. 
We set for aU n: 

Vn = M{X r n) (4.2) 
which is a martingale process. Then set 

Ln = HVn) (4.3) 

By definition of M we have for all n 

^ r (1 + 2^„)K with probability 1/2 + 5„ 

1 (1 - 2Sn)Vn with probability 1/2 - 6n ^ ' 



thus 



_ I Ln + ln(l + 2(5„) with probability 1/2 + (5„ , . 

^ 1 L„ + ln(l - 2Sn) with probability 1/2 - (5„ *■ 



Setting 

e„ - E[L„+i - L„] = (1/2 + 6n) ln(l + 2^„) + (1/2 - 5„) ln(l - 2d„) (4.6) 
(note en passant that e„ ^ 2(5^ by same method as (|4.19p ) we see that 

n-l 

L'n =Ln-Y. (4-7) 

is a martingale process. For all n we have ji'^^j^ — LJJ < en + 2Sn (here we use the 
fact that ln(l + x) < x for all x > —1). We can thus apply Azuma's Inequality 
[?,?lTn] to L'j! for all integers n and positive real a one has 

li{L'n > a}< exp f —r-^ I (4.8) 

Taking a = r In n (for an arbitrarily small real r > 0) in (|4.8p we get 

Since ^ 26f^ we have = o{Si), so 

n— 1 n— 1 

^(e, + 2(5,)^ - ^(2(S,)2 - 21nlnn (4.10) 

i=0 i=0 

Thus for any n large enough: 

r^(ln?i)^ 



Er=o(e. + 2<5,)^ 



<-21nn (4.11) 



Putting and (|ITTT|) together, we get 



^J■{^^ >r\nn}< — 



(4.12) 



for almost all n. By the Borel-Cantelli lemma [T^, since X^„l/?^^ converges, 
with ^-probability 1 the event [L'^ > rlnn] happens only finitely often, that is, 
with probabihty 1, for any r > and almost all n, L'^ < rlnn. Since 



and X]r=o 2 In Inn, it follows similarly that, with /i probability 1, for 

any r > and almost all n, L„ < rlnn. And as L„ = ln[Af(X [f n)], all this 
entails that with /i-probability 1, AI(X ^ n) < for any r > and almost all n. 
This proves Lemma [29l 

Let S) denote the class of integer-valued martingales. We now consider a re- 
striction of integer- valued martingales: let 2)' be the subset of D, consisting of 
the integer- valued martingales M that further satisfy M{a) < ^/\a'\ for almost 
all a. The following lemma shows that the martingales in D' are essentially as 
powerful as martingales in S against sequences X chosen at random according 
to IjL. 



Lemma 30. Let M E 1). For fi-almost all X, there exists M' E S)' such that 
M'{X It n) = Af (X ft n) for almost all n. 

Let M E 2). By Lemma [29l M{X ^ n) — o{^/n) almost surely. Hence, for /x- 
almost all X, there exists some no and all n > no, M{X |t n) < y/n/2. For such 
a pair (X, no), we call "invalid" all strings a such that there exists a prefix r of a 
such that |t| > no and either M(rO) > ^/\t\ or M(rl) > ^/\t\, and "valid" any 
string that is not invalid. Now, define the martingale M' by Af'(cr) — M{X ff no) 
for all a with \a\ < no and for all a with \a\ > no, set M'{a) to be M(t) with r 
the longest prefix of a that is valid. In other words, M' is the trimmed version 
of M that stops betting forever whenever M makes at stage n > no a bet that 
gives it a chance to get a capital > i/n. It is easy to see that M' is itself a 
martingale, integer-valued as M is, and since M{X [f n) < for all n > no, 

all prefixes of X are valid, hence M'{X ^ n) = M{X ff n) for all n > no. This 
proves the lemma. 

Finally, we prove that martingales in D' are almost surely defeated by a 
/x-random X. 




i=0 



Lemma 31. Let M E 2)'. For fi-almost all X , M does not succeed on X . 



Let hq be such that M{a) < ^JJo] for all a of length > uq. Again, we see X 
as a /i-random variable and define Vn by 



Vn = M{X r n) (4.13) 
(note that by definition of 3', we have Vn < for all n > hq) and i„ by 



L„ = ln[Af(X it n)] (4.14) 
with the convention ln(0) = — 1. For all n, define also 



M{X U + l)-M{X ^n) 

= M(XM ^ ^ ^ 

which is the fraction of its capital the martingale M bets on 1 at stage n. It can 
be negative if M bets on and is by convention 1 if M(X [f n) = 0. Similarly 
to (|4.5p . we have for all n: 

_ ( Ln + ln(l + Pn) with probability 1/2 + (5„ , . 

~ \ Ln + ln(l - /9„) with probability 1/2 - 5„ ^ ^> 

Thus we have: 

E[L„+i - Ln] = (1/2 + Sn) HI + Pn) + (1/2 - 5„) ln(l - Pn) (4.17) 

= i ln(l - pI) + Sn ln(l + Pn) - Sn ln(l - Pn) (4.18) 

<-Y+2(5„p„ (4.19) 



(for the last inequality, we use again that ln(l + x) < x for all x > —1, which 
is true even for x = —I with our convention ln(0) = — 1). Now, observe that pn 
is either 0, or of the form ^ for some integer to as M is integer-valued. In the 
first case Ln+i = Ln and in the second case, since Vn < \/n for almost all n, we 

2 

have \pn\ > l/%Ai for almost all n, and therefore E[L„+i — Ln] — ^ < as 
= o{l/y/n) — o{pn)- This shows that i„ is ultimately a supermartingale, and 
it is bounded from below by ln(0) = —1. By Doob's Martingale Convergence 
Theorem L„ converges to a finite value //-almost surely, hence the same is true 
for Vn = exp(L„). Therefore Vn is /i-almost surely bounded, hence M is /x-almost 
surely defeated. This finishes the proof of Lemma [311 

Theorem [28] now easily follows. Take some X E {0, 1}" at random accord- 
ing to p. By Lemma [311 X defeats all M € D' /i-almost surely, therefore by 
Lemma [30l X defeats all Af e S /i-almost surely. And finally, by definition of 
p and Theorem 1271 X is //-almost surely not Kurtz random. Therefore, X is 
/x-almost surely as wanted, hence the existence of at least one X as wanted. □ 



5 Non-monotonic betting strategies 



A non-monotonic betting strategy is a betting strategy in which the gambler 
can bet on the bits of a sequence in any order she chooses 7 . A set X is 
Kolmogorov-Loveland random if no recursive non-monotonic betting strategy 
succeeds on X and Martin-Lof random if no martingale with an increasing, 
recursive approximation succeeds on X . By a theorem of Muchnik, Semenov, 
and Uspensky [8] every Martin-Lof random is Kolmogorov-Loveland random, 
however the reverse containment remains a major open question for the field of 
algorithmic randomness. 

In the real-valued martingale case, every set which is computably random 
relative to K is also Martin-Lof random (unrelativized, follows from martingale 
definition of ML-random) and hence Kolmogorov-Loveland random. The situa- 
tion is a bit different for the case of integer- valued martingales. We shall show 
that no oracle can be given to a integer-valued martingale which will make it as 
powerful as its non-monotonic counterpart. 

Theorem 32. For every oracle B there is a set A <t B' and a non-monotonic 
{Q^\}-valued martingale such that the non-monotonic martingale wins on A 
while every B -recursive monotonic martingale fails to win on A. 

Proof. Let Mi, M2, M3, ... be a S'-recursive list of all integer- valued B- recursive 
martingales with the additional property that starts with at most 2™ dollars; 
note that such a list can be made by following the m**^ program as long as that 
program belongs to an integer-valued martingale with desired properties and 
to freeze the martingale as constant (always betting 0) if at some time the B- 
recursive martingale turns out to be partial or otherwise ill-defined. Note that 
although the m^^ program might not be total, the Mm are all total and uniformly 
B-recursive. 

The idea is to construct a recursive partition /q, /i, /2, . • . of intervals such 
that In is so long that only the minority of the positions in the interval are used 
to behave adversarially to Mi,M2, ■ ■ ■ ,M„ while the majority of the x in the 
interval satisfies A{x) = A[min(/„)]. The basic idea is to select A as follows on 
X e /„: 



Note that the length of /„ is determined although one does not know any- 
thing about the martingales. Let ai = 2"""'^"^+^ and inductively Cm+i = 
2min(/„)+m-Hai+a2-H...-Ha„_ rpj^g jjgg^ jg ^^^^^ stauds for the largest value which 

Mm can reach on the interval J„; the upper bound is determined by assuming 



(b 



b if Mm bets a positive value on 1 — 6 and 

all Mk with 1 < k < m abstain from betting; 
if .T = min(/„) and 

Ml, M2, . . . , Mn abstain from betting; 
A[min(/„)] if x > min(/„) and 

Ml, M2, . . . , Mn abstain from betting. 



A{x) 



< 



that Mm — in the worst case — can double its capital whenever the interval 7„ 
is not yet reached or that a martingale Mk with A; < m is betting which is then 
given priority in the definition of A. One can now verify by induction that each 
Mm can bet on J„ only at most am times until it would go broke and therefore 
there are at most ai places where Mi bets and loses 1 out of its capital; fur- 
thermore there are at most a2 places where M2 bets but Mi does not bet and 
on these M2 loses 1 out of its capital; there are at most 03 places where M3 
bets inside 7„ and Mi , M2 do not bet and on these places M3 loses 1 out of its 
capital. In total there are at most ai + 02 + . . . + a„ places on 7„ where one of 
the martingales Mi, M2, . . . , M„ are betting and therefore by taking /„ to have 
the length 2(1 + ai + 02 + . . . + a„) one gets that A[min(7„)] coincides with the 
majority of the values A{x) with x G In — {min(7„)}. 

This property permits to implement a non-monotonous recursive betting 
strategy which for every interval 7„ first reads all the values A{x) with x € 
In — {min(7„)} without betting any money on these values and then bets 1 ac- 
cording to the majority of the bits read before on the value A[min(7„)]; this 
bet is correct and a sure win. Hence A can be recognized by a non-monotonous 
{0, l}-valued martingale. 

Furthermore, one can find by induction values a;i,a;2,--. such that x„ > 
min(7„) and from Xn onwards no martingale Mm with to < n is betting on A. 
This is obviously possible for a;i = min(7i) as the other part of the condition is 
void. Now, whenever Mi bets on A beyond xi , the outcome is negative as A gives 
highest priority to diagonalize Mi. Therefore, Mi can bet only finitely often until 
the capital is used off and one can just take X2 to be the maximum of min(72) 
and the last time where Mi places a positive bet on A. Hence X2 exists and from 
X2 onwards, Afi docs not bet on A and therefore M2 is diagonalized with highest 
priority by A; again there are only finitely many positive bets and X3 can be 
chosen as the first value after these finitely many bets and after min(73). Hence 
one can inductively define the Xn and verify that M„ never has more capital 
than 2^"+^+". Thus no M„ succeeds on A and A is integer-valued random (with 
respect to -B-recursive monotonous martingales). □ 

We conclude with a canonical problem. 

Open question 33. Do there exist other characterizations for integer-valued, 
finite-valued, or single-valued randoms in terms of Kolmogorov complexity or 
Martin-Lof statistical tests? 
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